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Abstract 

Controllability properties for discrete-time, Markovian quantum dy- 
namics are investigated. We find that, while in general the controlled 
system is not finite-time controllable, feedback control allows for arbi- 
trary asymptotic state-to-state transitions. Under further assumption on 
the form of the measurement, we show that finite-time controllability can 
be achieved in a time that scales linearly with the dimension of the sys- 
tem, and we provide an iterative procedure to design the unitary control 
actions. 

1 Introduction 

For any controlled system, an in-depth study of its controllability properties un- 
der the available control capabilities is the necessary premise to the design of ef- 
fective controls addressing some given task. For quantum systems, in particular, 
controllability properties have been studied mostly considering continuous-time 
models in the presence of open-loop, coherent controls [THl ffl [HJ [31 El M HI] • hi 
this setting, the evolution is deterministic and the problem can be studied with 
the tools of geometric control theory. 

Indeed, for classical deterministic systems it makes little sense to distinguish 
open-loop and feedback controllability: the fact that the control law can benefit 
from partial or complete information on the system trajectory does not mod- 
ify the reachable set from a given initial state. In the quantum case, however, 
the introduction of measurements alone modifies the dynamical model by in- 
troducing a stochastic behavior, which has to be carefully taken into account. 
Considering the "open-loop" effect of measurements is not enough: the ability 
of conditioning the control choice on the measurement outcomes changes sig- 
nificantly the controllability properties, and in particular the set of reachable 
density operators as it will be argued later. 
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Continuous-time controllability of open-loop quantum dynamical semigroups 
have been studied in [4] [5] [12]. Some preliminary ideas about discrete-time, 
open-system controllability have been also previously explored in |29j . In that 
case, however, no reference to a specific set of control capabilities has been made 
(open-loop, closed-loop, coherent, incoherent, measurement-based control,...), the 
main focus being on the existence of general open-system dynamics connecting 
any given pair of states. 

In this paper we investigate the controllability properties of controlled, Marko- 
vian discrete-time quantum dynamics in open and closed loop. As a preliminary 
step, we will argue that a discrete-time system obtained by sampling inherits the 
open-loop controllablity properties from the continuous time underlying mode 
by resorting to previous results by Sontag (22] [23] . Open-loop controllability is 
a generic property for closed quantum systems, and this motivates our assump- 
tion of unitary controllability of the discrete-time systems we consider next. 
On the other hand, by introducing generalized measurements and closing the 
loop with conditional control actions, the dynamics drastically changes and our 
main results shall focus on this setting. We will present three simple examples 
illustrating how: (i) conditioning the control action on the outcome of a mea- 
surement influences the reachable sets of a controlled open-system evolution; 
however, in general (ii) feedback control does not in general ensure finite-time, 
state-to-state controllability; and (iii) feedback control does not allow for engi- 
neering of arbitrary dynamics. Next, we will prove that, under generic condition 
on the chosen measurement, feedback allows for asymptotic state-to- state con- 
trollability. Lastly, we will study a particular, yet not so restrictive in practice, 
class of controlled dynamics that exhibit finite-time feedback state-to- state con- 
trollability. As a byproduct of the proof of finite-time controllability, an explicit 
way to construct the sequence of control actions is provided. Remarkably, the 
(maximum) number of feedback steps needed to obtain any desired state-to- 
state transition scales linearly with the dimension, namely it is twice the size of 
the system's Hilbert space. 

The paper is structured as follows: after recalling the essential features of 
quantum systems in Section 12.11 and the relevant notions of controllability in 
Section 12.21 in Section [3] we argue that samples dynamics inherits open-loop 
controllability from the underlying continuous-time model. Beside being of in- 
terest by itself, the ability of enacting arbitrary control actions in finite-time is 
also a key assumption in Section [4] where we establish under which conditions 
feedback control ensures asymptotic state-to-state controllability. After pre- 
senting the general results on feedback approximate controllability in Section 2] 
Section [5] will describe a particular class of dynamics, proving that in this case 
finite-time state-to-state controllability can be achieved. 
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2 Discrete-time Quantum Dynamics and Con- 
trollability Notions 

2.1 Quantum Systems 

In this paper we will consider finite-dimensional quantum systems. Let us in- 
troduce some basic notation: to the quantum system of interest is associated 
an Hilbert space H ~ C N . In Dirac's notation (see e.g. 20!), vectors in % 
are denoted by kets, \ip) G %, while the linear functionals on % live on the 
dual space 1-0 and are denoted by bra, Inner products are then represented 
by (<f>\i/)) (bra(c)kets). 9Jl(H) denotes the set of linear operators on %. Con- 
sider X G SJt('H): its action on bras and kets is defined by X\ij)) := X(\ip)), 
(ip\X := where f denotes the adjoint of operators (and consistently 

the transpose-conjugate for their matrix representations). 

Self-adjoint (Hermitian) operators are denoted by X^ = X G £)(%), and 
are associated to observable variables for the system. In a quantum statisti- 
cal framework, a state for the system is associated to trace-one, self-adjoint and 
positive-semidefinite operator p. Let us denote by Q(H) the set of states or den- 
sity operators. The subset CP('H) C £>(%) denotes the set of rank-one orthogonal 
projectors, the pure states. D{'H) is a convex set, whose extreme points are the 
pure states *$(%), and its border 5Q(H) contains all the states that are not full 
rank. 

In this paper we will consider generalized measurements, with a finite num- 
ber of possible outcomes labeled by an index k. Assume a system is in the state 
p. A generalized measurement is associated to a decomposition of the identity 
J2k MuM k = I, Mk G dJl(H) that allows to compute the probability of measur- 
ing the k-th outcome as: 

F p (k)=tr(M kP Ml), 
and the conditioned state after the measurement as: 

= M k p(t)Mj 
' lk tv(M k p(t)Ml)' 

A particular case is represented by direct measurements of observables, or pro- 
jective measurements: consider an observable X G $)(H), with spectral repre- 
sentation X = J2k ^fcHfc) J2k Hfc = J2k Hfc = I- The eigenvalues correspond to 
the possible outcomes of the measurement, labeled by k, and the probabilities 
and conditioned states can be computed by the formulas above with = life . 

We shall consider dynamics in the so-called Schrodinger picture, where the 
state is evolving while the observables are time- invariant. It follows from Schrodinger's 
equation (see next section, equation ([5])) that an isolated, closed quantum sys- 
tem evolves unitarily: in discrete time, this means that for a sequence of times 
t = 0, 1, 2, ... , with time- intervals normalized to one, we have 

p(t + l) = U{t)p(t)U\t), (2) 
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with U(t) £ ii(H) for all t's (here &{H) C 971(H) denotes the subset of unitary 
operators). In the open quantum system setting, general physically admissible 
evolutions are described by linear, Completely Positive and Trace Preserving 
(CPTP) maps [12113] ■ Any CPTP map T via the Kraus-Stinespring theorem 
[16] admits explicit representations of the form 

T[p]=J2 M kPMl (3) 

k 

also known as Operator-Sum Representation (OSR) of T, where p is a density 
operator and {M k } a family of operators such that the completeness relation 

M t M k = 1 (4) 

ft 

is satisfied. We refer the reader to e.g. [21[TnilEI for a detailed discussions of the 
properties of quantum operations and the physical meaning of the complete- 
positivity property. We recall that maps in the form @ preserving the identity, 
T(I) = I, are called unital. It is well known that the OSR of a given CPTP 
map is not unique: in fact the following holds (see Q15], Theorem 8.2): 

Theorem 2.1 (Unitary freedom in the OSR) Assume {M k }™ =1 and {N k }^ =1 
be OSRs of quantum operations £ and T , respectively. If m ^ n, append zero 
operators to the shortest list so that m = n. Then £ = T if and only if there 
exist a unitary n x n matrix U — [uki] such that: 

In the rest of the paper, however, opeV-system dynamics will be obtained as 
averages over states conditioned on a given measurement, followed by unitary 
control. By averaging over the possible outcomes of a generalized measurement 
we get: 

p=M{ P )=Y J f P (k)p\k - M ^ M l 

k k 

which is a CPTP map, and physically represents the expected effect of a mea- 
surement on the state, when the outcome is not known. The fact that p ^ p is 
a remarkable difference with respect to classical probability. Also notice how, 
of all the possible OSR associated to the unconditional M. , only one, {Mk}, will 
corresponds to the correct conditional states via |T]) . This means that when con- 
sidering feedback protocols based on the conditional states (as we do in Section 
[4J, different OSRs are not equivalent, and we have to consider the fixed OSR 
associated to the underlying measurement. 

2.2 Notions of Controllability 

When dealing with dynamics depending on external controls, it is of phys- 
ical interest to know whether or not these controls can be chosen so as to 
drive the state of our model between two given configurations, either exactly 
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or approximately. Different notions of controllability can be given depending 
on which is the relevant state for the dynamics. As an example, when deal- 
ing with multilevel quantum mechanical systems evolving in continuous time 
we may look at the evolutions on the complex unitary sphere, on the unitary 
operations, or on the density matrix operator. More precisely, denoting by 
H(u(t)) = Hq+Y^JLx HjUj(t) the Hamiltonian including the controls, and con- 
sidering the system isolated, we can study controllability of the Schrbdinger 
equation, 

= -iH(u{t))\m), with \m) e (5) 

describing the evolution on the complex unitary sphere associated to pure states, 
or the corresponding equation acting on the propagator, 

X(t) = -iH{u(t))X(t), with X(t) e &{H), 

or again the Landau-von Neumann equation 

p(t) = -i[H{m),p{t% (6) 

for the evolution on the density operators. Thus, according to the problem we 
are looking at, we may be interested to the action of the same Hamiltonian to 
either \if>), X or p. Of course, the controllability properties are connected: notice 
that if X(t) denotes the solution of the second equation with initial condition 
X(0) = I, then we have \ip(t)) = X(t)\ip(0)) and p{t) = X (t) p(0) X (t)t . These 
relations provide some correlations among the different types of controllability. 

In this paper we will deal instead with controlled open quantum models 
evolving in discrete time on the set of density operators. The dynamics will be 
generically described by: 

p(t+l)=£(p(t),u(t)), (7) 

with /?(•) G T)(H) and u(t) 6 U, and where U is the set of controls. Later we will 
be precise about the set of controls U and the form of the map £. In particular, 
we will deal with the case where £ comes from sampling a continuos time model 
evolving according the Landau-von Neumann equation (see ©), and with the 
case where £ is a CPTP map emerging from measurement and feedback unitary 
control (see (fTO)) '). Since the subset ty(H) C D(H) of the pure states have 
a special physical meaning, we introduce the following different definitions of 
controllability properties. 

Pure state to Pure state Controllable (PPG) in T steps: if for every pure 
initial state po — \ip){i/>\ € ^{T~L) there exist a sequence of controlled dynamical 
maps £i, . . . ,£t € C such that any other pure pf G *P("H) can be reached at 
finite time T. 

Density operator to Density operator Controllable (DDC) in T steps: if for 
every initial state po G T)(H) there exist a choice of controls such that any other 
pf € T)(H) can be reached in finite time T. 

Analogous definition can be given for Pure state to Density operator Con- 
trollable (PDC) and Density operator to Pure state Controllable (DPC). Clearly, 
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being c3(M), it holds that: 



DDC => DPC PPC, 

DDC =^> PDC =^> PPC. 

Weaker (approximate) versions of the same controllability properties are of par- 
ticular interest when dealing with discrete-time systems coming from sampling 
continuous time models. In fact, for these models, there are results correlat- 
ing the continuos time controllability with the discrete time one, see Section [3] 
below. 

It is also possible to think to some notions of dynamical propagator control- 
lability, where, instead of looking at the problem of steering a given initial state 
to a fix final one, we look at the possibility of realizing some given dynamical 
maps. We say that a system is: 

Unitary controllable (UC) in T steps: if given any U G il("H) there exist a 
choice of controls that realizes the unitary evolution given by equation ([2]) as a 
composition of T evolutions £j, i.e. 

Uprf = £ T o---o£ 1 (p), VpeD(H) 

(where £,(A) =£{A,Ui)). 

Kraus map controllable (KC) in T steps: if given any £ (see equation (J3])) 
exists a choice of T controls such that £ — £ t ° • • ■ ° £\ ■ 

Some immediate relationships between the notions are: 

KC =>> DDC, KC UC PPC. 

The first implication has also been highlighted in [29]. It can be easily derived 
considering a constant mapping from D (H) to pf <E 55 (H), Pf being the target 
state. This map can be extended to a linear CPTP map on 031(H), and hence 
it admits an OSR (by Kraus-Stinespring theorem [TBI ITS"] ). 

3 On open-loop discrete-time controllability 

Controllability results for open-loop, coherent control are well established, and 
they are essentially based on the Lie-algebra rank condition. Moreover, the 
ability of realizing arbitrary unitary operators in finite time will be key to the 
results on feedback controllability. This section is devoted to discuss under 
which conditions this can attained, at least approximately. Consider the con- 
trolled Landau- von Neumann equation ([B]), the system is then controllable in 
continuous time if the Jurdievic-Sussman Lie-algebraic rank condition is satis- 
fied [TO]. 

Theorem 3.1 The system 



tn 

p(t) = -i[H + Y J H 3 u ] (t),p(t)], 



(8) 



is controllable if and only if the Lie-algebra generated by the Hamiltonians, 
Lie{— iHo, —iHi, . . . , —iH m }, is the full su(N). 

This condition is generic even with a single control field, that is, almost every 
pair of drift and control Hamiltonian, Hq and Hi, ensures that the associated 
control Lie algebra is the full su(N) [3J. 

Let us introduce the discrete-time model by forcing the control functions 
Uj(t) to be piece- wise constant on intervals long S (in the terminology of |23] . 
they are sampled control functions), and considering the associated evolution: 

p(t + 6) = U(u(t))p(t)uHu(t)), (9) 

where U(u(t)) = Texp ^J^ H(u(t + r))drj , and Texp denotes the formal, or 

time-ordered, exponential. Let us call fftj,(po) CS(M) the set of states reach- 
able from po by sampled control functions in T steps, and 

oo 

m 5 ( Po ) = (J 3&(po). 

T=l 

We say that the system ((6]) is sampled controllable (either sampled PPC, PDC, 
DPC or DDC) if for every pair of states po,Pf (in <$(%) or D(H) according to 
the type of controllability considered) there is a sample time S such that pf is in 
9i 5 (po), while it is approximately sampled controllable if for every pair of states 
po, pf there is a sample time 5 such that pf is contained in the closure of 91 s (po). 
Sontag proved the following results on the relationship between (continuous- 
time) controllability and sampled controllability |HJ . 

Theorem 3.2 If a dynamical system on a simply connected group is controllable 
(in continuous time), then it is sampled controllable. 

Theorem 3.3 If a dynamical system is controllable (in continuous time), then 
it is approximately sampled controllable. 

In our setting, considering the dynamical equation ([§])■ Theorem 13.21 ensures 
that if the system is continuous-time controllable, we can obtain any unitary 
operator in a finite number of discrete set by sufficiently fast sampled control. 
An open problem concerns establishing estimates of the time needed to realize 
a given unitary transformation, and how the sample time may depend on the 
degree of the accuracy we require for approximate sampled controllability. 

4 Results on Feedback Controllability 

4.1 Discrete-time feedback control and background 

We introduce here a discrete-time, Markovian feedback control scheme [6j [18l 
[14] . that has been recently studied in depth in [7] focusing on stabilization 
problems. Assume that we can: 
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(i) Enact a fixed, given generalized measurement associated to an OSR {M k }; 



(ii) Engineer a set of arbitrary unitary control action Uk(t) G ii(H) at each 
time t, choosing U k when the fc-th outcome of the measurement is obtained. 

Thus, if the state at time t was p(t), the state at time t + 1 conditioned to 
the fc-th outcome of the generalized measurement is: 

P ( f + l)| fc= ^ )Mfc f )M ^ t(t) . 

tr(MlM kP (t)) 

Hence, averaging over the possible outcomes we get: 

Pit + !) = E U k (t)M kP (t)Mlut(t). (10) 
k 

We next recall a characterization of the OSRs that can be realized by ex- 
ploiting these control capabilities [7 . This and the following results heavily rely 
on a canonical form of the QR decomposition that is recalled in Appendix [A"l 

Proposition 4.1 A measurement with associated operators {Nk}T—i can be 
simulated by a certain choice of unitary controls from a measurement {M k }™ =1 , 
if and only if there exist a reordering j(k) of the first m integers such that: 

T(N k )=T(M m ) 1 

where T returns the canonical R factor of the argument, as described in Ap- 
vendixTM 

The potential of the feedback strategy for pure state preparation is estab- 
lished by the following [HE]. 

Theorem 4.1 Consider a subspace orthogonal decomposition T-Li — Us © T~Lr, 
dim('Hs) = 1, and a given generalized measurement associated to Kraus opera- 
tors {Affc}. Let {R k } be the canonical R-factors associated to {M k } in a basis 
consistent with the Hilbert space decomposition above. The task of achieving 
global asymptotic stability of ps — II5 by a feedback unitary control policy is 
feasible if and only if there exists a k such that: 

[p s ,R- k ]^0. (11) 

Notice that if a pure state is globally asymptotically stabilizable, it means that 
it belongs to the closure of D\ s (po) for any initial state po S In the 

next sections we will use this fact to link the feedback stabilization problem to 
feedback controllability problems. 
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4.2 Three examples 

We here present three examples that will provide motivation for the study of 
feedback controllability, and counterexamples to generic, finite-time DPC (and 
hence DDC) and KC properties. Yet, they will suggest some natural questions 
about weaker controllability properties. Let us agree that SH(/o) denotes the 
reachable set from p. 

Example 1: Feedback- controllability is different from open-loop controllabil- 
ity. An extreme example is the following: Consider a completely depolariz- 
ing channel £ for a two-level system, with {Mo — -^=I,M\ — -^*a x ,Mi — 
Ag<Ty,M3 = ^ a z}- After a single application of the measurement, the average 

state is projected onto p = i/, the completely mixed state. No subsequent, 
unconditional choice of control U has any effect on the dynamics: for t > 0, 

P (t + 1) = U£{p(t))tf = u (j2 M kp(t)M^j = ~I. 

This means that OK(po) = {-g-Tf, for every po. On the other hand, if conditional 
controls {£4} are allowed, it is easy to see that choosing e.g. {Uk — y/4UMl}, 
we get 

P (t + 1) - U k M k p(t)M%ul = Up(t)W. 

k 

Hence, at least the set of p isospectral to the initial condition p(0) is in the 
reachable set: 

{p £ D(H)\p = Up{Q)U\ U e Si(H)} C 9t(p(0)). 

However, even the feedback control strategy we are considering has its limita- 
tions. A key one is the time needed to reach the desired state, in particular pure 
states. 

Example 2: Feedback purification cannot in general be obtained in finite time. 
Consider a full rank state p(t) > 0. Assume that the generalized measurement 
we consider has OSR {M\,M2}, with at least Mi is full rank. Then for any 
control choice {Ui^}, we have that: 

UxMip{t)M\ul > 0, 

while U 2 M 2 p{t)M\ul > 0. Hence, being a sum of a strictly positive operator 
and a positive semidcfintc one, p(t + 1) > 0. By iterating the above reasoning, 
we get that pit) > for any < t < oo. Thus, no state on the border of 35(H) 
can be reached in finite time from a generic state. The following generalization 
of this example is in fact immediate: 

Proposition 4.2 Consider a feedback controlled system as in (|10[) . If at least 
one of the M k s in the OSR has full rank, then no state on 510 [H) is reachable 
in finite time from 1D(H) \ 555(H). 
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One is then lead to ask: is the controlled system at least asymptotically 
DPC? Is there a set of conditions under which the system can be rendered DPC 
in finite time? We will prove that feedback discrete-time quantum dynamics are 
generically asymptotically (or approximately, in the definition given in Section 
[3]) controllable. In Section [S] we provide some conditions on the measurement 
OSR that ensure that feedback system is both DPC and PDC in finite time. 

Example 3: Feedback control does not ensure Kraus-map controllability. Con- 
sider two CPTP maps on a two-level system, with OSRs 



and 



Mi = VP 







a 




Mi 



,N 2 = 



i o 
o 1 



o VT 



with 1 > a > 0. Note that the first OSRs elements are scalar multiples of 
unitaries, and hence they both have scalar matrices as canonical i?-factors, 
while the second OSR is already in canonical form. Assume we want generate 
the CPTP map associated with {N±, N2} by feedback control as in (fT0|) . The 
canonical i?-factors being different, the only hope is to feedback-enact an OSR 
that is equivalent to {Ni,Nz}. However, it is immediate to see that for any 
E/i, Ca € tt(H) the dynamical map 



P (t + 1) = J2 U k M kP (t)Mlul 



fe=l,2 



remains unital, while the one associated to {Ni, N2} is not. 

At a first look, this may seem in contrast with previous results: for example, 
the main result in |18) shows how to feedback engineer arbitrary measurements 
on the system of interest by using an ingenuous combination of ancillary sys- 
tems, simple interaction Hamiltonians, projective measurements and fast-pulse 
control. The attained result is a weaker KC property, that needs more general 
control capabilities, including (essentially) the ability of changing the measure- 
ment action, and ensures that the enacted dynamics corresponds in general to 
the desired one only at lower-order (in time). What is the class of CPTP maps 
one can realize via feedback? A partial answer, of course, is given by Proposition 
4.11 However, due to the non uniqueness of the OSR, the fact that the target 
CPTP map has an OSR that in canonical form is the same of the measure- 
ment used in the feedback loop is only sufficient for its realizability by means of 
a feedback protocol. Providing conditions for exact KC, or characterizing the 
reachable set of propagators are, to the best of our knowledge, open problems. 



4.3 Generic asymptotic controllability 

Enforcing generalized measurements on the system, one does not lose pure state 
controllability. 
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Lemma 4.1 Assume that the controlled system dynamics is described by (|10p . 
Then the system is PPC in one step. 



Proof: Consider a pure initial state p = \ip)(4>\ and a target pj — \<j>f){^>f\- The 
state conditioned on the fc-th outcome of the measurement step is then p\k = 

|0fc)(0fe|, with \<pk) = Mk\ip)/\J (tl>\MlMk\ip). Then to reach pf is sufficient to 
consider a set of control actions {Uk} such that Uk\4>k) = IV 7 /) f° r each k. □ 

Can we always prepare a given pure state starting from an arbitrary density 
matrix? The answer is generically positive, at least asymptotically, if we allow 
for feedback control. 



Theorem 4.2 Assume the system dynamics to be described by (|10p. with a 
fixed measurement with OSR {M&} and arbitrary conditional control actions 
{Uk} C U('W). Then the system is approximately DPC if and only if there is a 
k such Mfc 7^ qVk, for every q £ C, and Vk € ii(H). 

Proof: As a first step, by properly constructing a basis and invoking Theorem 
14. 1[ we will first show that a pure state is stabilizable if Mk 7^ qVk- This condition 
implies that the corresponding canonical i?-factor is Rk 7^ ql- Let us consider 
two cases: 

A) If at least one of the canonical factor is not diagonal, i.e. there exists an 
element 7^ with j < £, reorder the basis so that the j-th basis vector 
becomes the first, and the £-th is the second. Since the two corresponding 
columns in Rk were not orthogonal, they will remain so after the change of 
basis. Hence, when computing again the canonical i?-factor, the upper-right 
2x2 block will be in the form 





a 


b 




Rk — 





d 












* 



with b 7^ 0. According to TheoremETTl the state p s = \ip)(ip\, \ip) = (1,0, ...,0) T 
in the new basis, can be made globally asymptotically stable. 
B) If all the i?^s are diagonal, but at least one is not a scalar matrix, we can 
find a reordering of the basis so that the upper-right 2x2 block of the one Rk 
is in the form 





a 







Rk — 





d 


* 










* 



with a 7^ d. Let us consider a further unitary change of basis V (acting on the 
right of Rk, that modifies the upper left block of Rk- 



V 



1 

71 



" 1 


1 


" 




1 


-1 





, RkV 








I 





1 

71 



a 


a 




d 


-d 
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Now, being a ^ d,its first two columns become not orthogonal. If we compute 
the canonical R- factor R' k of RkV, its first two columns become not orthogonal, 
and hence 





' a 1 


b' 


" 


R 'k - 





d 













* 



with b' ^ 0. Notice that the construction above works also for d — 0. Thus 
the state p'j = \ip')(ip'\, \ip'} — (1,0,..., 0) T in the new basis can be made 
asymptotically stable by feedback control. 

To conclude the "if" implication, assume we reach a e-neighborhood (in trace 
distance) of at some time T — 1. Then on the T step we can apply a different 
set of unitary control actions, as in Lemma 14. 1[ which realize the one-step 
transition p'j to pf, and since CPTP maps are trace norm contractions we end 
up in a e'-neighborhood (in trace distance) of pf, with e' < e. On the other 
hand, assume that Rf. = q^I, Vfc. Then the feedback dynamics (ITU1) becomes: 

P (t + l) = Y,QkUkPWl 
k 

A map of this form can only reach states in the convex hull of the set isospectral 
to p{t). Hence if p(0) is in the interior of Q(W), the closure of the reachable set 
9\(p(0 j) cannot contain any pure state. □ 

It is worth remarking that: (i) the proof is constructive, since it implicitly 
uses the constructive result of [7]; (ii) relying on a stabilization procedure, the 
control strategy is robust with respect to uncertainty on the initial state po; (iii) 
the time needed for approximately reaching an e-neighborhood of the target 
state can be estimated by computing the slowest eigenvalue of the feedback- 
controlled map. (iv) the condition Mk ^ qVk for some k is generic, and it fails 
only for probabilistic average of unitary effects. In other words, the class of 
measurements that do not allow for DPC are those that are associated to an 
average over the conditonial states of the form: 

P = J2P" U kpUl (12) 

k 

Furthermore, this corollary of Proposition l4.2l com.es at no cost: 

Corollary 4.1 Assume that we can control the system as in Theorem \4-°J\ above. 
Then asymptotic feedback purification of the state can be achieved if and only if 
there is a k such ^ qU^, for every q g C, and Uk £ U(H). 

The results above in turn imply that feedback makes the system DDC, provided 
that we can randomly choose the unitary controls in a finite set with given 
probabilities: 

Corollary 4.2 Assume that we can control the system as in Theorem \4-S\ above, 
and in addition we can pick a control action at random from a finite set {Uj} 
with an arbitrary probability distribution {pj}- Then the system is approximately 
DDC if and only if there is a k such Mk ^ qVk, with q € C, and Vk € il('H). 
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Proof: By Theorem l4.21 there exists a finite time T so that we can get arbitrarily 
close to a pure state \^p){ip\. Assume the target state is pf = J2jPj\4>j)(<l ) j\7 an d 
define the control actions Uj so that Uj\ip) = \<j>j)- Than at some time T it 
suffices to extract at random a Uj with probability {pj}, so that the average 
dynamics (disregarding which Uk has been extracted, gives 

□ 

Notice that, up to the last step, the choice of the unitary control actions is 
time-independent, that is, at each iteration the average dynamics is represented 
by the same OSR: 

£(p(t)) =J2UkM kP (t)Mlul 
k 

5 Sufficient conditions for finite-time state con- 
trollability 

Assume that a certain generalized measurement has only two outcomes, and 
associated operators Mi and M 2 such that: 

MlMi + m\m 2 = I. (13) 

Moreover, assume: 

1. Both matrices are diagonal; 

2. Both matrices are singular. 

Assumption 1) is not restrictive under feedback control assumptions, as it shown 
in the following lemma. 

Lemma 5.1 Consider two generic M\,M2 that satisfy (|13p . Then there exist 
a unitaries Uo,U\,U2 such that Mj = UjMjUo is diagonal for j = 1,2. 

Proof: By appropriately choosing the reference basis through a unitary Uo, and 
a enacting a (feedback) unitary U\, we can diagonalize any Mi, by e.g. singular 
value decomposition UiMiUq = Mi = diag(ai, . . . , c^n)- Then A = UqMI^Uq 
must be diagonal, since (| 13[) holds, and hence it admits a diagonal square root 
of the form U 2 M 2 U Q . □ 
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Given assumption l)-2), without loss of generality, the two matrices Mj have 



then the following form with respect to a reference basis {\ej)}j =1 



Mi = 





a 2 

a 3 





a N 



, M 2 = 



Pi 



p 3 





p. 



N 



(14) 



,N, 



where, to satisfy (fl"3]l . we must have \a 2 \ — |/3i| = 1 and, for i = 3, 
|ck»| + = 1. It is immediate to see that a measurement in this form is 
able to distinguish with certainty at least the first two orthogonal states of the 
basis in which Mi , M 2 have the form (fM)) . We can now prove that the feedback 
controlled dynamics is finite-time DPC. 

Proposition 5.1 There exists a choice Ui(0), • • • , Ui(N—2) and U 2 (0), • • • , U 2 (N- 
2), such that for any po — 7i|ui)(ui|, p(N) is a pure state. 

Proof: Let w be the unit vector such that the target state p(N) is equal to 
|w)(ui|. For i = 0, ... ,N — 3, define the two matrices U\(i) and U 2 (i) as the 
permutations matrices defined by the following relationships: 



Ui(i)\ei) = |eAr_i) 
U\{i)\e N -i) = |ei) 
Ui(i)| ei ) = \e 3 ), j^l,N-i, 
U 2 {i)\e j ) = \e j ), j^2,N-i 



U 2 {i)\e2) = \dN-i) 
U 2 (i)\e N -i) = \e 2 ) 



(15) 



and let U\{N — 2) and U 2 (N — 2) be any two unitary matrices such that 

^i(JV-2)|e a ) = H, U 2 (N-2)\ ei ) = \w). (16) 

We first prove by induction on k = 0, . . . , N — 2, that p(k) is of the following 
type: 

l k N-k 

p(k)=J2^)(z^\, with \z^) = J2^) s \e s ), (17) 

3=1 «=1 

that is, at step k the state pk has support only on the subspace generated by 
the first N — k basis vectors, {le^)}^^ . For k = the statement is trivial, so 
assume that (TTTl) holds for k < N — 2, then 

2 

p(fc + 1) = Ui(k)M iP (k)M^Ui(k)l 
i=l 

We have, for i = 1, 2 : 



U t (k)M lP (k)Mj (k) t=V (fc)Mi |z, fc ) (4 1 M/C^ 



3 

3=1 
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Moreover it holds: 

N-k 

U 1 {k)M l \z k j ) = Y^ifysUmM^es 



s=l 

N-k N-k-X 



^2^) a a a U 1 (k)\e B ) = (^)sa s \e s ) + 

s=2 s=2 
N-k-1 

+ {c k j )N^ka N -k\e 1 ) = J2 (S fc+1 )^l e 

s=l 

Using the same argument and exchanging 1 with 2, we get 

N-k-l 

U 2 (k)M 2 \z*) = £ 



s| e s ) = 1^ 



s=l 



Thus equation (ITTl) holds for fc + 1 with: 

for j = 



Zfc+i = 2/ fc and 



for j = l k ,.. .,l k+ 



Using dT71) for = JV — 2, and letting omitting for simplicity the index N 
we have: 

i 

p(N-2) = J2Pj\zj)(*jl 
j'=i 

with |zj) = (cj)i|ei) + (cj)2|e 2 ). Now we have: 
2 i 

p(N-l) = J2Yl h U ( N - 2)M i \z J ){z j \MiU{N - 2)t. 

i=l 3=1 

Moreover: 

(7(iV - 2)M 1 \z j ) = U(N - 2)Mi ((cj)i|ei) + (c^M) 
= ^(JV-2)( Ci ) 2 |e a ) = ( Ci ) 2 H, 

and, analogously, 

[/(iV - 2)M 2 |^) = U(N - 2)M 2 ((coxier) + ( Cj -) 2 |e 2 )) 
= U(N-2)(c j ) 1 \e 1 ) = (c j )i\w). 

Thus, summing up, we obtain: 
I 

pim) =J2fr (lfe) 2 | 2 + |(c,)i| 2 ) \w)(w\ = \w)(w\, 

3=1 

as desired. 

The converse is also true, that is, the system is finite-time PDC. 
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Proposition 5.2 Assume that po is a pure state, then for any pj- — X^j=i Ji\ v i) ( v i\ > 
there exists a sequence of controls of length N that steers po to pf. 

Proof: The explicit construction of a set of effective controls can be done fol- 
lowing the procedure detailed below. 

First step: Prepare an appropriate pure state. Assume that po = If 
Mi\w) — 0, then let Ui(0) be any unitary matrix, if Mi\w) ^ 0, then let Ui(0) 
be any unitary matrix such that 

Um (p^jSSfij) = ^» + y/Q=ri\ei) = \zi). 

Then, p(l) is again a pure state and we have p(l) = \z\)(z\\. 

Second Step: Preparing the first element. Let U\(l) be any unitary matrix such 

that f/i(l)|e 2 ) = |ejv), and t/ 2 (l) be any unitary matrix such that 

U 2 {l)\e 2 ) = ^^|e 2 ) + ^/l-^-ler) = |*>. 
With this choice we have: 

2 

p(2) = ]T UiWMizMz^MjUiQ.? = 

i=l 

- 7i^i(l)|e 2 )(e 2 |t/i(l) t + (1 - 7i)^2(l)|ei)(e 1 |t/ 2 (l) t 
= 7il e w)( e wl + (1 - 7i)k2)(z2|- 
Successive steps. Notice that e^v and z 2 are orthogonal. Let U\(2) be such that: 

C/ 1 (2)|e JV ) = \e N ), f/i(2)|e 2 ) = | ejV -i), 

and let C/ 2 (2) be such that: /7 2 (2)|eAr) = |ejv), and 

C ' 2(2)|ei> " ^T^W«>+ 
^-Trfel"> " ' 2s> ' 

Now we have: 

P(3) = 

C/ 1 (2)M 1 ( 7 i|eiv)(e N | + (1 - -yi)\z 2 )(z 2 \) M 1 t C/ 1 (2)t + 
*7 2 (2)M 2 (7i|ejv)(eiv| + (1 - tOI^X^I) M 2 t (7 2 (2) t 
= 7i|aiv| 2 |ew)(eAr| + 72|ejv-i)(ejv-i| + 7i|^A r | 2 |ew)(eAr| 
+ (l-(7i+7 2 ))k 3 )k3| = 

= 7l| e Jv)( e A r l + 72|eAr_l)(eAf„i| + (1 - (71 + 72)) \z 3 ) (z 3 \ . 
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Iterating this construction, after N — 1 steps, we will get: 



p(N - 1) = 7i|ejv)(ejv| + 72|ejv-i)(e]v-i| + • • ■ + 
+7JV-2|e 3 )(e 3 | + ^1 - \z N -i)(z N -i\, 

with 



7iv-i 


1-1 


t 1 - 








+ V 1_ i-(i-(^s)) |ei> 

Fina/ iwo steps: finalizing the construction. Now, letting Ui(N — 1) = U2(N 
1) =7, we obtain: 

p(iV) = 7i|eAr)(eAr| + 72|eAr-i)(eAr_i| 
+ ...7JV-i|e 2 )(e 2 | + 1 - [Y^ 7i l e i)( e il = 



. »=i 



AT 



= ^ Ji\eN~i+l) (eN-i+1 1- 

1=1 

Next, define U\(N) = [/2(jV) = ^> wnere ^ is the unitary matrix such that 
f/|e») = |ujv-i+i)- We then get: 

AT 

p(JV + l) = 5^7 < |« i )<i; i | ) 

i=l 

as desired. □ 



6 Conclusions and Outlook 

We investigated the controllability properties of discrete-time Markovian quan- 
tum dynamics, in particular showing that sampled, open-loop dynamics inher- 
ited their controllability properties from the underlying continuous-time models, 
and that the ability of implementing discrete-time feedback generically allows 
for complete DDC, but only asymptotically. Furthermore, we have shown that 
the ability of implementing simple, two-outcome measurements with singular 
operators makes the system DDC in closed loop and in finite time. That is, by 
extracting just one bit of classical information at the time, with at least the abil- 
ity of discerning two pure states with certainty, we are allowed to feedback-enact 
arbitrary state-to-state transitions in an iV-level system, and the time needed to 



17 



reach the desired state is just 2N. This result shows e.g. how feedback cooling- 
can be obtained in finite time, and not only asymptotically, for discrete-time 
evolutions. Our results also complement the ones presented in |S], and the 
discussion in Section [3] support for the strong assumption of unitary open-loop 
controllability of the discrete-time system. Some open questions remain, and 
need further investigation: if the measurement OSR is not of the form (TT2"j) . is 
the system feedback KC? Can the strategy presented in Section [5] be extended 
to OSRs with more than two operators? 

The presented analysis also suggests that similar results may be pursued for 
continuous-time QDS. The techniques developed in [351 UHl IM] f° r QDS engi- 
neering by open-loop and output-feedback control, in the spirit of [28 , could 
be used to overcome the generic absence of controllability pointed out by [H [5] . 
Another interesting and timely development would be to study how the con- 
trollability properties change in presence of locality constraints in multipar- 
tite, distributed quantum systems. The use of noise engineering for quantum- 
computation related tasks has recently received considerable attention from the 
physics community [151 127) , but many fundamental control-theoretic questions 
remain unanswered. Lastly, in Section [3] we considered the effect of sampling on 
the controls: another constraint, worth of further investigation, might be intro- 
duced by their quantization. When limiting the choice of the control functions 
to a countable (or finite) set, the controllability issues appear to be strongly con- 
nected with the problem of establishing universality of a set of unitary gates, 
and the problem of efficiently (in polynomial time with respect to the number 
of components of the system) generating the desired gates [TTJ [17l Qjj] . 

A A canonical QR decomposition 

In this appendix we recall some technical results about QR decomposition that 
lead to a canonical form with respect to the left action of the unitary matrix 
group. 

Definition A.l (QR decomposition [13j) A QR decomposition of a complex- 
valued square matrix A is a decomposition of A as 

A = QR, 

where Q is a unitary matrix and R is an upper triangular matrix. 

The QR decomposition of a given complex-valued square matrix A is not 
unique. In the case of non-singular matrix A, one can show that the upper 
triangular factors of any two QR decompositions of A differ only for the phase 
of their rows. When A is singular, on the other hand, this is not true. However, 
introducing some conditions on the R matrix, it is possible to obtain a canonical 
form for the QR decomposition in a sense that will be explained later in this 
section. The following theorem characterize the canonical QR decomposition 
and guarantees its existence. 
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Theorem A.l Given any (complex) square matrix A of dimension n, it is pos- 
sible to derive a QR decomposition A = QR such that 

r y =0 yj<n,yi>pj (18) 

where pj is the rank of the first j columns of A, and such that the first nonzero 
element of each row of R is real and positive. 

The proof of this theorem [7] also provides a method to construct such a decom- 
position, by a variation of the standard orthonormalization approach. Moreover, 
we can prove that the R obtained in this way is a canonical form. Let Q be 
a group acting on C nxn . Let A,B e C nxn . If there exists a g e Q such that 
g(A) = B, we say that A and B are equivalent, and we write A ^g B. 

Definition A. 2 A canonical form with respect to Q is a function T : C nx ™ — > 
C nxn such that for every A, B € C nxn : 

i. T{A) ~g A; 

ii. J- (A) — J~(B) if and only if A B. 

Let us consider the unitary matrix group U(n) C C nx ™ and consider its action 
on C" xn through left-multiplication, that is, for any U £ U(n), M £ C nxn : 

U(M) = UM. 

The following result has been proven in [7]. 

Theorem A. 2 Define J~{A) = R, with R the upper-triangular matrices ob- 
tained by the procedure described in the proof of Theorem \A.1[ Then J- is a 
canonical form with respect toU(n) (and its action on <C nxn by left multiplica- 
tion). 
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